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Introduction 


•  Information  is  represented  in  neurons  by  sequences  of  action 
potentials  (spikes). 

•  The  response  of  a  neuron  to  a  given  stimulus  exhibits  variability. 

•  Standard  model:  an  underlying  time-varying  probability  function 
governs  the  firing  of  spikes,  usually  modeled  as  a  non- stationary 
point  process. 

•  We  measure  the  response  of  cell  to  broadband  sounds  and 
derived  Spectro-Temporal  Receptive  Fields  (STRF),  a  linear, 
quantitative  descriptor  of  how  a  cell  responds  to  dynamic  sounds. 

•  When  predicting  responses  to  a  new  sound,  there  is  a  difference 
between  the  response  predicted  by  the  STRF  and  the  actual 
response.  How  much  difference  is  due  to  non-linearity,  and  how 
much  is  expected  from  neural  variability,  such  as  a  Poisson 
processes? 
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Summary 


•We  previously  modeled  cells  in  Primary  Auditory  Cortex 
(AI)  of  ferrets  as  responding  linearly  to  the  low-passed 
envelope  of  incoming  sounds. 

•We  model  the  response  of  a  cell  by  a  linear  convolution 
between  an  STRF  and  the  envelope  of  the  sound. 

•  There  is  typically  a  difference  between  the  predicted  response 
and  the  actual  response.  How  much  can  be  attributed  to 
intrinsic  variability  in  the  neural  firings,  and  how  much  to 
non-linear  effects? 

•  We  conclude  that  most  of  the  difference  is  attributable  to  the 
intrinsic  variability  (“noise”)  of  the  neurons,  as  manifested  by 
the  (non-homogeneous)  Poisson  statistics  of  the  firings 
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STRFs  in  Al 


Cells  are  characterized  their  Spectro- 
Temporal  Response  Field  (STRF)... 


...  or  by  the  (Fourier  domain) 
ripple  transfer  function  (TF). 


Moving  ripples  form  the  basis  for  the  Fourier  domain  description  of 
dynamic  spectra.  At  time  t  and  frequency  x,  the  amplitude  S(t,x)  is  given  by: 
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£2  (cycles/octave) 

S(t,x)=  sin(27iw£  +  2tiGIx  +  O) 
x  =  log2[/V/o] 

w  =  ripple  velocity,  modulation  rate 
£2  =  ripple  frequency,  spectral  density 
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f  Temporally  Orthogonal  Ripple  Combinations 

•  STRF  measured  by  reverse-correlating  with  dynamic  spectrum  of  a 
broad-band  stimulus. 

•  Temporally  Orthogonal  Ripple  Combinations  composed  of  ripples  with 
different  modulation  rates. 


Allow  clean  STRF  estimates  in  relatively  short  time. 

S(t,x) 


□  □□□□□  ■ 


(spikes/ 

sec) 


250  ms 


The  stimuli  shown  contain  ripples  covering 
the  same  range  of  ripple  velocities,  but  at 
different  ripple  frequencies. 
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/  (kHz) 


4  Predicting  Responses  from  STRF  * 


The  response  to  an  arbitrary  sound  is  predicted  by  the  convolution  of  the 
STRF  with  the  stimulus’  spectro-temporal  envelope  (plus  a  constant). 

R(t)  {STRFest(f,  x)  S{t,  x )}  +  E{R(f)} 
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I  Bootstrap  Technique  ^ 


•  From  presentation  to  presentation,  there  is  variability  or  “noise”. 

•  We  use  resamples  of  data  to  estimate  variability. 

•  Resamples  are  of  same  size  as  original  samples:  N  samples  of  bootstrap 
data  are  drawn  with  replacement  from  the  N  original  samples. 

•  Repeat  procedure  many  times  to  create  a  population  of  bootstrap 
resamples  whose  probability  distribution  is  a  good  estimator  of  the 
probability  distribution  from  which  the  original  data  was  drawn. 

•  Mean,  variance,  and  higher  order  moments  of  bootstrap  population  are 
good,  unbiased,  estimators  of  those  same  moments  of  the  true 
distribution. 

•  Related  to  “Jackknife”  technique. 
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Bootstrap  Example 


Raster  Data  30  sweeps 
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Mean  firing  rate:  25.0  spikes/s 

Percentage  ISI  =  40  ms:  0.23% 
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Bootstrap  distributions 


i  Normal 
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28  spikes/s 
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Best  Estimate 

Bootstrap  mean 
and  standard 
deviations 

N=  500 
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226/20a04. m2- . spk  8  Hz,  -0.4  cyc/oct,  65  dB 


g  Poisson  Statistics  * 


•  The  measured  observable  is  the  spike  train,  which  we  model  as  a  Poisson 
random  variable. 

•  Assume  underlying,  deterministic,  probability  density  for  firing,  r(t ) 

•  #  of  measurements  (stimulus  presentations)  =  n 

•  probability  of  measuring  N  spikes  between  t  and  At:  p(N(t;At))  =  r(t )  At 

•  Expectation  values  for  mean,  t|,  and  variance,  c,  of  N: 

T[N(t;At)  :=  E{N(t;At)}  =  n  r(t )  At 

aN2(t;At):=  E{(N[t',At)]2}  -  [rj^;A/)]2  =  %(t;AO  =  n  r(t )  At 

•  Thus  a  prediction  for  the  Fano  factor: 

§N(t;At)  :=  T\N(t;At)/aN2(t;At)  =  1 
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—  Poisson  Variance  Examples 

Examples  of  the  computation  of  the  Fano  factor  for  two  cells, 
one  “clean”  and  the  other  very  noisy. 
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Examples  Continued 


The  actual  response 
lies  nicely  within  the 
variability  predicted 
by  Poisson  noise. 


The  variance  in  the 
measured  response 
corresponds  nicely 
to  the  predicted 
variance. 


Center  for  Auditory 
and  Acoustic  Research 


100  150 

time  (ms) 


200  250 


Institute  for  Systems  Research 
University  of  Maryland 


226/24a06.al-  predicting  24a07.al-  Wfm  10 


Predictions  with  Variability 


•  The  actual  response 
lies  nicely  within  the 
variability  predicted 
by  Poisson  noise. 


•  The  variance  in  the 
measured  response 
corresponds  nicely 
to  the  predicted 
variance. 
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Signal  to  Noise  Theory 


Define  observed  firing  rate:  R(t;At )  =  (1 In)  N(t,At)/At 

r\R(t,At)  :=E{R(P,At)}  =  r(t) 

oR2(t;At) :=  E{[R(t;At)]2}  -  \r\R(t;At)]2  =  r(t)/(n  At) 

Signal  &  Variance  (“Noise”)  Power: 

P  :=  Z,  [KO]2  PG-=  Z, 

Signal  to  Noise  Ratio: 

SNR  :=  P/PG  =  n  At  (X,  mf)  /  (Z,  ko) 

SNR  grows  with  rate 

SNR  proportional  to  number  of  repetitions  (more  general  than  Poisson) 
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Signal  to  Noise  in  Practice 


•  Variability  analysis  distinguishes  high  SNR  (  >  1) 
from  low  SNR 

•  SNR  for  good  cells  increased  (linear  with  steep 
slope)  with  #  of  sweeps  n. 


SNR 


SNR  for  linear 
component  of  good 
cells  is  much  higher 
than  that  for  non¬ 
linear  component. 
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Increasing  the  SNR 


Frequency  domain: 

•  ryco)  =  ^F{Pa(t)}  is  constant  for  all  CO. 

•  In  practice,  11(G))  =  ^F{P(t)}  is  band-limited,  so 

jcrit 

n(G>). 


t  n  «»>=£ 


•  We  can  increase  the  SNR  by  using 

crit 

SNR'"tT  :=  pincr IP  incr  n(C0) 

•  This  is  done  implicitly  by  binning  or,  when  deriving  the  STRF, 
using  low-passed  frequency  envelopes. 
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Singular  Value  Decomposition  — 


•  Singular  Value  Decomposition  (SVD)  can  be  used  to  estimate  the  rank  of 
a  matrix  corrupted  by  noise.  It  decomposes  the  matrix  into  a  sum  of  rank 
one  matrices,  ordered  by  magnitude.  The  first  k  components  sum  to  a 
matrix  of  rank  k  which  minimizes  the  power  of  the  remaining  components. 


•  We  apply  SVD  to  each  quadrant  of  the  transfer  function.  Below,  an  STRF 
and  the  three  most  significant  quadrant-separable  components,  derived 
from  SVD,  are  shown. 


Raw  Estimate 
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r  Singular  Value  Decomposition  Example 
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•  SVD  naturally  picks  out  high  SNR  components  of  a  matrix. 

•  Large  jumps  in  the  singular  values. 

•  Jumps  straddle  bootstrap  estimate  of  noise. 

•  Noise  can  be  removed  by  discarding  lower-magnitude  components. 
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